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Animating Image Editing Apparatus and 
Animating Image Editing Method . 



BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to animating image 
editing apparatus and animating image editing method 
for editing a coded animating image. 
Related Background Art 

Recently, coding methods of coding a digital 
animating image at a high compression ratio by using an 
inter frame correlation have been standardized as 
international methods. There is an MPEG as a 
representative method. According to the MPEG, an 
inter frame correlation is maximally used, a motion 
compensation is performed with reference to frames 
before and after a frame to be coded, and after that, 
an inter frame differential coding is executed. Fig. 5 
shows an example of the MPEG coding. In the coding 
frame types of the MPEG, I frame, P frame, and B frame 
have been coded as shown in the diagram. The I frame 
is the independent frame in an intraframe code and one 
frame is inserted per 15 frames. The P frame is a 
forward motion predictive frame and is an interframe 
code for performing the motion compensation by 
referring to the one-preceding P frame or the I frame. 
The B frame is an interframe predictive code for 



performing the motion compensation by predicting from 
both directions of the P and I frames before and after 
the B frame. The motion compensation is performed on a 
unit basis of a block which is called a macro block 
(MB) as shown in Fig, 6. The MB is a unit such that an 
animating image is digitized at a sampling ratio of 
4 : 1 : 1 of Y (luminance component) and Cb and Cr 
(color difference components) and, after that, Y 
(16 x 16 pixels), Cb (8 x 8 pixels), and Cr (8 x 8 
pixels) are set to a block. The motion compensation is 
executed in the B and P frames. Since the blocks 
having a strong correlation -kao^to be searched (vector 
search) on a macro block unit basis, there is a 
drawback such that the processes of a coding unit are 
complicated as compared with those of a decoding unit. 
Particularly, when the coding is executed only by ^ 
software, it is difficult to execute it in a real-time 
manner. It is, therefore, a present situation that 
only the decoding is performed by & software. When the 
coding unit is realized by ff hardware, there is a 
drawback such that the circuit scale is extremely 
large. 

As another problem, there is a problem at the 
time of the edition. Fundamentally, since the 
interframe difference is coded, it is difficult to 
perform a cut edition between arbitrary frames. For 
example, when an animating image is divided into two 
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sequences at; the position of (T) in Fig. 5, there is a 
drawback such that the last frame cannot be decoded in 
the preceding sequence and the frames up to the next I 
frame cannot be decoded in the later sequence* 
5 As a first method of solving the foregoing 

problems , there is a method of decoding all of the 
coded frame images and editing the decoded frame images 
C$ after that. 

P The above method, however, has a drawback such 

SI 

gl 10 that a memory of a large capacity is necessary to once 

yj 

(jj accumulate the images after they were decoded, 

g In the above method, there -is also a problem 

53 such that since all of the frame images need to be 

J| decoded irrespective of a fact such that the frame to 

^ 15 be edited is a part of animating image and the decoded 

images are again encoded to accumulate them after that, 
the image deterioration is large. 

As a second method of solving the foregoing 
problems, there is also an animating image processing 
20 apparatus using the intraframe coding method. For 
instance, there is a motion JPEG in which the JPEG 
system which is a coding of a color still image is 
independently applied to each frame of an animating 
image. In case of the motion JPEG, since the coding is 
25 also the intraframe coding, it is not so complicated as 
in the MPEG and a frame edition can be also freely 
performed. However, since the interframe correlation 



is not used, there is a drawback such that a 
compression efficiency is remarkably worse than that of 
the inter frame coding. 

SUMMARY OF THE INVENTION 

It is an object of the invention to provide an 
animating image editing apparatus and an animating 
image editing method which can solve the foregoing 
drawbacks - 

It is another object of the invention to provide 
an animating image editing apparatus and an animating 
image editing method which do hot require a memory of a 
large capacity when an editing process of coded 
animating image data is executed. 

According to a preferred embodiment of the 
invention, the above objects are accomplished by an 
animating image editing apparatus comprising decoding 
means for decoding coded animating image data, storing 
means for intraframe coding the decoded animating image 
data and storing, editing means for decoding the 
intraframe coded image stored in the storing means and 
for performing an arbitrary edition to the image, and 
coding means for coding the edited frame image by an 
animating image coding method. 

Still another object of the invention is to 
provide an animating image editing apparatus and an 
animating image editing method in which an amount of 
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image data to be decoded is extremely suppressed when 
an editing process is performed for a predetermined 

fir Further another ^ obj ect of the invention is to 

5 provide an animating image editing apparatus and - an 
P( animating image editing method in which^iftptrt an 0 

animating image data can be coded at a high speed and 



W an image can be compressed at a high compression after 

P edition. - 

(X Qfl 10 -F**g"fehe r another ^ obj ect of the invention is to 



IH provide an animating image editing apparatus and an 

Q animating image editing method which can easily and 

6S 

g promptly edit an animating image. 

PC /J Furth e r — a n et h er^ obj ect of the invention is to 
15 provide an animating image editing apparatus and an 
animating image editing method which can edit an 
interframe coded -anr animating image while minimizing a 
deterioration of a picture quality. 

-Fw fthfcsjL another- obj ect of the invention is to 
20 provide an animating image editing apparatus and an 

animating image editing method having a novel function. 

The above and other objects and features of the 
present invention will become apparent from the 
following detailed description and the appended claims 
25 with reference to the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 



Fig. 1 is a diagram showing the first: 
embodiment; ; 

Fig. 2 shows an example of a display picture 
plane for edition; 

Fig. 3 is a diagram showing the second 
embodiment; 

Fig. 4 shows an example such that an intraframe 
coding was performed to a part of a sequence; 

Fig. 5 is a diagram showing a state of a 
sequence when an inter frame coding is performed; 

Fig. 6 is a diagram showing a macro block; 

Fig. 7 is a block diagram showing a 
constructional outline of a system according to the 
fourth to sixth embodiments; 

Fig. 8 is a block diagram of a main section of 
the fourth embodiment; 

Fig. 9 is an explanatory diagram of the fifth 
embodiment ; 

Fig. 10 is a block diagram of a main section of 
the fifth embodiment; and 

Fig. 11 is a block diagram of a main section of 
the sixth embodiment . 

DETAILE D DESCRIPTION OF THE PREFERRED EMBODIMENTS 
<First embodiment> 

Fig. 1 is a block diagram of the first 
embodiment. Reference numeral 1 denotes a video camera 
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for inputting an animating image; 2 a capture board 
unit for forming each frame of the animating image; 3 a 
JPEG codec unit for performing intraframe coding and 
decoding (processing a program by a CPU 9); 4a disk 
for accumulating animating images; 5 a video RAM unit 
for outputting the decoded animating image to a display 
7; 6 an MPEG codec unit for coding/decoding an 
inter frame coded animating image (processing a program 
by the CPU 9 ) ; 9 the CPU to control the apparatus . An 
animating image to be processed is inputted from the 
video camera 1 and is digitized by the video capture 
board" unit. Reference" numeral 19 "denotes" an - operation - 
unit including a mouse, or a pointer, which will be 
described hereinlater. In the embodiment, (360 pixels 
x 240 lines) construct one frame and digital animating 
images of 30 frames per second are formed. As pixel 
signals, the Y, Cb, Cr signals obtained by the sampling 
at the sampling ratio of (4 : 1 : 1) which is performed 
by the MPEG or the like are used. The Y, Cb, and Cr 
signals formed by the capture board unit 2 are coded in 
the frame by the JPEG codec unit 3 through a computer 
bus 8 in a real-time manner. The coding is executed by 
the JPEG system by regarding each frame as a still 
image on a frame unit basis. Since the JPEG coding 
system has been well-known, the description is omitted 
here. The coded animating images of 30 frames/second 
are stored into the disk 4 through the computer bus 8 
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in a real-time manner. In parallel with the coding, 
the digital animating images formed by the capture 
board unit 2 are sent to the video RAM unit 5 and are 
converted to the RGB signals for displaying the 
5 animating images and, after that, the images are 

displayed by the display 7 in a real-time manner. By 
the processes as mentioned above, while the animating 

Q 

88 image inputted from the video camera 1 is displayed by 

O the display 7 in a real-time manner, the image is coded 

OH 10 by the JPEG codec unit 3 and the coded data is stored 

W 

LT| into the disk 4. The input of the animating image to 

-3 . . ___ . ... _ 

Q the disk 4 is continued until one animating image scene 

m 

(hereinafter, referred to as a sequence) is finished. 
One sequence after completion of the input is 
15 reproduced on the display 7 as necessary. The 

reproducing process is performed as follows. Codes of 
one sequence are sequentially read out on a frame unit 
basis and are sent to the JPEG codec unit 3 which can 
perform the coding at a speed higher than that in the 
20 MPEG through the computer bus 8 and are decoded. The 
decoded frames are sequentially transferred to the 
video RAM unit 5 on the frame unit basis as Y, Cb, and 
Cr signals of (360 pixels x 240 lines) and are 
displayed by the display 7 in a manner similar to the 
25 case of the foregoing real-time animating image input 
display (hereinlater, such an operation is called as a 
normal reproduction ) . 



When one animating image sequence is inputted, 
generally, unnecessary portions are often included at 
the positions before and after or in the halfway of the 
sequence. According to the embodiment, therefore, the 
editing process is performed by using a feature of the 
intraframe coding such that each frame is independent. 

Fig. 2 shows an example of edition. Reference 
numeral 7 denotes the display in which an edition 
window 10 is displayed. In the edition window 10, each 
frame of the sequence of the decoded animating image is 
displayed in a reduced size. As for the reduction, a 
normal method of simply thinning out is used and a 
resolution is decreased to a value such that the 
contents can be known, thereby enabling a few frames to 
be simultaneously displayed. Reference numeral 15 
indicates a frame as a target point at the time of the 
edition. Reference numeral 14 denotes a one-preceding 
frame; 13 a two-preceding frame; 12 a three-preceding 
frame; 16 a one-later frame; 17 a two-later frame; and 
18 a three-later frame. 

In case of the normal reproduction, a frame of a 
size of (360 pixels x 240 lines) is displayed in 
another window (not shown). At the time of the edition 
reproduction, however, since a plurality of frames 
before and after the target frame are displayed as 
mentioned above, the pixels reduced to about (1/4 x 
1/4) are reproduced. In the edition reproduction, the 
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frame 15 is set to a reproduction point and the frames 
before and after such a frame are moved and displayed 
as shown by an arrow. The frames are displayed in a 
normal speed mode, a slow speed mode, sequential frame 
5 display mode, or the like as necessary- Reference 
numeral 11 denotes an edition tool bar for cutting 
unnecessary frames and for selecting only necessary 
frames. Fig. 2 shows a state in which the frames 13 to 
17 are selected (bars of the hatched portions) by a 
CP 10 mouse or a pointer. In this case, the frames before 

Ul the frame 12 and the frames after the frame 18 are 

3 

™ unnecessary portions. The frames other than the 

necessary portions selected as mentioned above are 
139 

*Q deleted and edited from the disk 4. Since the code 

SI 

15 data stored in the disk 4 are the intraframe coded 

data, it can be easily edited. In the embodiment, the 
editing process is executed by the CPU 9 in a software 
manner. The edited code data can be confirmed by 
performing the normal reproduction as mentioned above. 

20 The editing process mentioned above is performed 

on the basis of the intraframe code data which can be 
easily edited. After the edition, the intraframe code 
is converted to the inter frame code having a 
compression efficiency higher than that of the 

25 intraframe code and the animating image is efficiently 
restored to the disk 4. One sequence of the edited 
intraframe codes stored in the disk 4 is read out every 
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frame and is decoded by the JPEG codec unit 3 in a 
manner similar to the normal reproduction. Since there 
is no need to again convert the intraframe code to the 
inter frame code in a real-time manner, however, it is 
sufficient for the JPEG codec unit 3 to decode in 
accordance with the speed of the inter frame coding. In 
the embodiment, the MPEG system is used to again encode 
the decoded animating image to the interframe coded 
frame image. Since the re-encoding is performed by pf 
software by the CPU 9, it is executed by an idle time 
of the CPU. 

According to the MPEG coding, as shown in Fig. 
5, the data is interframe/ intraframe coded into three 
kinds of frame types of I, P, and B frames. The coded 
frames are again sequentially stored into the disk 4 in 
accordance with the order from the frame after 
completion of the coding and the above operation is 
continued until the end of the sequence, thereby 
finishing the re-encoding. After that, by deleting an 
unnecessary sequence of the intraframe codes, it is 
converted to the sequence in which the compression 
efficiency is improved so that the disk 4 is 
efficiently used. 

As mentioned above, the animating image sequence 
which was re-encoded to the interframe codes is 
sequentially decoded by an MPEG codec 6 as necessary 
and can be also similarly produced to the display 7 via 
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the video RAM unit 5. 

As mentioned above, the input of the animating 
image is coded by the intraframe coding in a real-time 
manner, so that the coding can be easily performed with 
5 a small circuit scale as compared with the case of 

using the inter frame coding by the MPEG. By using the 
intraframe code, the animating image can be easily 
edited. By converting the intraframe code to the 
inter frame code of a good compression efficiency after 
■=1 io the edition, the animating image process such that the 

g? 

W input edition of the animating image is easy and the 

= n 

= compression efficiency is high is realized. 

Q 

Qg < Second embodiment > 

3 

m Fig. 3 is a diagram showing the second 



15 embodiment. The second embodiment relates to a case 
where animating images have already been converted to 
digital codes and stored in a CD-ROM or the like. In 
Fig. 3, reference numeral 20 denotes a CD-ROM player 
which is connected to the computer bus 8 by an SCSI 

20 bus. In Fig. 3, the same component elements as those 
in Fig. 1 are designated by the same reference 
numerals. The CD-ROM player 20 is an animating image 
reading apparatus for displaying animating image data 
generally stored in the CD-ROM onto the display 7. 

25 Codes are read out from the CD-ROM player 20 at a 

predetermined bit rate. It is generally desirable that 
such a kind of animating images for accumulation have 
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been interframe coded from a view point; of the 
compression efficiency. In the second embodiment, a 
case where the animating image coded by the MPEG system 
is read out from the CD-ROM will be described. Codes 
5 of one sequence read out from the CD-ROM player 20 are 
decoded by the MPEG codec 6 via the computer bus 8 in a 
real-time manner. The frame images (360 pixels x 240 
lines; Y, Cb, and Cr signals) sequentially decoded are 
again sequentially converted every frame to the JPEG 
^ 10 codes as intraframe codes by the JPEG codec unit 3 

H~ through the computer bus 8. Simultaneously, the frame 

images decoded by the MPEG codec 6 are normally 
reproduced onto the display 7 via the video RAM unit 5. 
CO The sequence coded by the JPEG codec unit 3 is 

15 sequentially stored into the disk 4 by an amount 

corresponding to a sequence of a necessary length. 
After completion of the storage, as described in the 
first embodiment, the frame edition can be performed as 
necessary. It is also possible to again convert the 
20 intraframe code to the interframe code in order to 
raise the compression efficiency. 

As mentioned above, while decoding the 
interframe coded animating image, by re-encoding to the 
intraframe code, the edition on the frame unit basis 
25 can be promptly and easily performed. 
< Third embodiment > 

In the second embodiment, although the MPEG 



- 14 - 



codes have been decoded and converted to the intraframe 
codes with respect to all of the sequences, only the 
neighboring frames to be edited can be also converted 
to the intraframe codes as follows. In Fig. 3, in a 
5 recording medium ( the CD-ROM in the third embodiment ) 
which can perform the optical recording, magnetic 
recording, or the like, the MPEG codes (interframe 
codes) stored in the CD-ROM are decoded by the MPEG 
% \ codec 6 and only the display operation is performed, 

rj ; 10 In this instance, the re-encoding by the JPEG codec 

J=J?; unit is not executed. As for the display, the edition 

y i reproduction is performed as described in Fig. 2. As 

Qi mentioned above, the necessary portions are designated 

C| by the edition tool bar 11. In the case where the 

15 editing portions have been interframe coded, however, 
the frame edition cannot be easily performed. 
' Therefore, a partial intraframe coding conversion as 

shown in Fig. 4 is executed. As an interframe code, 
the I, P, and B frames are encoded every fifteen frames 
20 between the I frames by the MPEG encoding as described 
in Fig. 5. 

For example, in case of cutting the portion of 
(T) between the B frames in each of the second and 
third frames in Fig. 4, the last B frame of the 
25 previous sequence of the cut portion cannot be 

reproduced. In the later sequence, a state in which up 




to the next I frame cannot be reproduced (broken link) 
occurs. In the embodiment, therefore, four frames 
between the P frames (between the I and P frames in 
case of the I frame) including the cut portion are 
decoded and are again encoded to the I frame, so that 
the frame edition at an arbitrary position can be 
performed. Four frames including the portion to be cut 
in the sequence which was read out from the CD-ROM 
player 20 in Fig. 3 are decoded by the MPEG codec 6 and 
can be also partially again encoded as an intraframe by 
the CPU 9 in an operational processing, i.e., a 
software manner. In place of again encoding to the 
intraframe in a software manner, the intracoding can be 
also performed by the JPEG codec 3. Instead of 
decoding all the encoded frames, by partially again 
encoding to the intraframe code only frame images in 
minimum number including frame images indicated to be 
edited upon editing, in which the frames which are not 
edited can be reproduced later, as in the embodiment, 
there is no need to again encode to the interframe code 
for the purpose of the improvement of a compression 
ratio after the edition. A deterioration of the 
picture quality can be also minimized to the portions 
before and after the edition. 
< Fourth embodiment > 

The fourth embodiment will now be described with 
respect to the case where the MPEG system is used as a 




coding system of animating image coding data which is 
inputted, the JPEG system is used as an intraframe 
coding system that is used in the apparatus, all of the 
frames of the animating image coding data which is 
inputted are code converted, and an editing operation 
is executed. 

Fig, 7 is a constructional diagram of the 
animating image editing apparatus of the embodiment. 
Reference numeral 101 denotes a system bus to control 
the whole system; 102 a code converting unit I for 
decoding animating image coding data that is inputted 
and for converting into the intraframe coding data; 103 
an animating image editing unit for decoding the 
internal coding data and for performing an animating 
image edition; and 104 a code converting unit II for 
again converting the result of the animating image 
edition to the animating image coding data. 

Fig. 8 shows a detailed block construction of 
each processing unit. In the diagram, the same blocks 
as those shown in Fig. 7 are designated by the same 
reference numerals. 

The code converting unit I ( 102 ) comprises three 
blocks 120, 121, and 122. Reference numeral 120 
denotes an MPEG decoder for decoding a bit stream which 
is animating image coding data that is inputted and 
which was encoded by the MPEG system; 121 denotes a 
JPEG encoder for encoding the decoded frame image data 



by the JPEG system as an intraframe code; and 122 a 
memory or file to store an output of the JPEG encoder 
121. 

The animating image editing unit 103 comprises 
five blocks 122, 124, 125, 126, and 122, Reference 
numeral 124 denotes a JPEG decoder; 125 an editing unit 
to edit the animating image on a frame unit basis; 126 
a JPEG encoder to JPEG encode the image data edited by 
the editing unit 125 on the frame unit basis; and 122 
the memory or file to store an output of the JPEG 
encoder 126. 

The code converting unit 104 comprises two 
blocks 122 and 129. Reference numeral 129 denotes an 
MPEG encoder to encode by the MPEG system. 

A processing procedure of the animating image 
editing apparatus of the fourth embodiment will now be 
described hereinbelow with reference to Fig. 8. 

First, when the animating image coding data 
which has previously been stored in the memory or the 
like and encoded by the MPEG system is designated from 
the user by using a pointing device such as a mouse or 
the like (not shown), the designated animating image 
coding data is sequentially decoded by the MPEG decoder 
120 in the code converting unit 102 in accordance with 
the order of the MPEG bit stream. Subsequently, the 
image data of every frame as an output result is 
inputted to the JPEG encoder 121 and is JPEG encoded on 
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a frame unit basis and is stored into the memory or 
file 122. The user retrieves an arbitrary frame to be 
edited from the image data which was stored in the 
memory or file 122 and was JPEG encoded, so that an 
animating image editing process can be performed. 

As an animating image edition, the frame 
designated by the user is read out from the memory or 
file 122 and is decoded by the JPEG decoder 124 and is 
returned to the frame image. An editing operation is 
executed by the editing unit 125 to the image data 
returned to the frame image. The editing operation in 
the embodiment denotes that the image data itself in 
the frame is rewritten. The frame image after 
completion of the editing operation is again encoded 
every frame image by the JPEG encoder 126 in order to 
store into the memory or file 122. When there are a 
plurality of frames to be edited, the above editing 
operation is repeated. After completion of the editing 
operations of all of the frame images to be edited, the 
coding data which was JPEG encoded every frame by the 
code converting unit 104 is read out from the memory or 
file 122. The animating image encoding is executed in 
the MPEG encoder 129 by the MPEG system to all of the 
frames . 

According to the embodiment as mentioned above, 
after the intraframe coding using the JPEG system was 
performed to the input animating image coding data 



encoded by the MPEG system, the picture plane to be 
edited is retrieved and is subjected to the editing 
process and the animating image encoding is again 
executed. Thus, the animating image coding data can be 
edited and the memory capacity can be remarkably 
reduced as compared with that in case of decoding all 
of the animating image coding data. 
< Fifth embodiment > 

The fourth embodiment has been described with 
respect to the example in which after all of the image 
data which had been animating image encoded by the MPEG 
system was decoded, it is edited. The fifth embodiment 
will be explained with respect to the case where only 
the image data of the portions necessary for edition is 
decoded from the image data which was animating image 
encoded by the MPEG system and is subjected to the 
editing process. 

In the fifth embodiment, it is assumed that the 
image data which was animating image encoded by the 
MPEG system is intraf rame encoded ( intra-picture ) every 
15 frames. It is also assumed that 20 frames within a 
range from the 20th frame to the 40th frame are used as 
frames to which the user performs the editing process. 

In this case, the image data which is inputted 
and was animating image encoded by the MPEG system has 
a construction as shown at 138 in Fig. 9. In the 
diagram, reference numerals 130 to 134 denote positions 



of the intra-picture in the image data which is 
inputted and was animating image encoded by the MPEG 
system. For example, the intra-picture 130 indicates 
the Oth frame. The next intra-picture 131 indicates 
the 15th frame. In case of the embodiment, since 20 
frames (the 20th frame to the 40th frame) are edited, 
it is sufficient to decode and edit the data with a 
range from the intra-picture 131 to the intra-picture 
133 in a bit stream 138. 

A construction to execute the above processes 
will now be described with reference to Fig. 10. 

In the diagram, blocks which execute operations 
similar to those in the fourth embodiment are 
designated by the same reference numerals. In the 
diagram, reference numeral 140 denotes an intra - 
detector to detect a frame image as an intra-picture in 
the image data which was animating image encoded by the 
MPEG system. 

First, the bit stream 138 is inputted to the 
intra-detector 140. After that, the data within a 
range from the intra-picture 130 to the frame before 
the intra-picture 131, namely, to the 14th frame is 
outputted to a line 141 as an inputted bit stream and 
is stored into a predetermined file. When the code of 
the intra-picture 131 is detected, the frames of the 
intra-picture 131 and subsequent intra-pictures are 
outputted to a line 142 in order to perform the editing 




process. The data of the bit stream outputted to the 
line 142 passes through the MPEG decoder 120 and JPEG 
encoder 121 and each frame is encoded by the JPEG 
system and is supplied to the memory or file 122. The 
intra-detector 140 outputs the signal to the line 142 
until the code of the intra-picture 133 is detected. 
After the code of the intra-picture 133 was detected, 
the output is again returned to the line 141 and the 
subsequent bit stream is outputted to another file 
different from the above file. 

Coding data 135 and 137 are filed as mentioned 
above without being subjected to the editing process. 

Processes such that the user edits the 20 frames 
(the 20th to 40th frame) will now be explained. 

The frames (the 15th to 44th frame) have been 
stored in the memory or file as coding data which was 
encoded by the JPEG system. The JPEG coding data 
within a range from the 20th frame to the 40th frame is 
read out from the memory or file 122 and is decoded by 
the JPEG decoder 124, so that the image data is formed. 

After that, the frames (the 20th to 40th frames) 
are edited by the editing unit 125 and are JPEG encoded 
by the JPEG encoder 121 and are stored into the memory 
or file 122. After completion of the editing 
operation, the JPEG coding data is read out from the 
memory or file 122 and is decoded into the image data 
by the JPEG decoder 124. The image data is further 
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MPEG encoded by the MPEG encoder 129 and is out put ted 
to a file or the like. The output result is filed as 
coding data 136 in Fig. 9. 

The coding data 135, 136, and 137 are finally 
rearranged into a bit stream as one coding data by a 
CPU or the like (not shown), so that the edition of 
only the necessary frames which are desired by the user 
can be performed. 

In the fifth embodiment, after completion of the 
animating image edition, the frames edited by the JPEG 
system are again encoded by the MPEG system. However, 
the invention is not limited to such a construction. 
It is also possible to construct as follows. Namely, 
the image data after the edition is stored into the 
memory or file 122 without being JPEG encoded. Only 
the frames which are not subjected to the editing 
process, namely, only the frames (the 15th to 19th 
frames and the 41st to 44th frames) as JPEG codes are 
decoded by the JPEG decoder 124 in the embodiment. The 
edited frames which are not encoded are directly 
outputted to the MPEG encoder without passing through 
the JPEG decoder 124. 

With the above construction, when the animating 
image edition is executed to a predetermined frame, an 
amount of image data to be decoded can be reduced, so 
that the memory capacity to store the image data after 
it was decoded can be reduced. The time that is 




required for decoding can be also decreased. 
Consequently, "the animating image edition can be 
executed at a high speed. 
<Sixth embodiment> 

The above fifth embodiment has been described 
with respect to the case of using the JPEG system as an 
intraframe coding system. However, as shown in Fig. 
11, the encoding process can be also performed by the 
intra-pictures in an MPEG chip. In the diagram, the 
component elements which execute the similar operations 
as those of the component elements in the fourth and 
fifth embodiments are designated by the same reference 
numerals . 

The sixth embodiment differs from Fig. 10 as a 
block diagram of the fifth embodiment with respect to a 
point that an MPEG encoder 150 is used in place of the 
JPEG encoder 121 and an MPEG decoder 151 is used in 
place of the JPEG decoder 124. 

The detailed operations are substantially the 
same as those in the fifth embodiment except that the 
portions which are stored into the memory or file 122 
are the coding data of the intra-pictures of the MPEG. 
Therefore, the description of the operation principle 
is omitted here. 

Although the MPEG system has been used as an 
animating image coding system of the input in the sixth 
embodiment, the invention is not limited to such a 
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system but can be also obviously applied to the H261 
system or, further, to another animating image coding 
system. 

Although the internal coding system has been 
described with respect to the JPEG system and the 
intra-pictures of the MPEG, the invention is not 
limited to them but can be also applied to, any system 
so long as it is the intraframe coding system. 

Although the embodiments have been described 
with respect to the example in which the image in the 
frame is changed as an animating image edition, the 
invention is not limited to such an edition. It is 
also possible to change the number of frames or to 
execute an editing operation in the time base direction 
such as extraction of frames, insertion of frames, or 
the like. 

It will be also obviously understood that the 
animating image coding data is communicated from 
external communicating means in a real-time manner. 

When the image data stored in the memory or file 
122 is edited, the image of only the low frequency 
component is decoded from the image data of one frame 
and is displayed on a monitor (not shown), thereby 
deciding the edition image by using the image of a low 
resolution. After that, all of the images of one frame 
are displayed and are subjected to the actual editing 
process. Thus, the editing process can be performed at 
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a high speed. 

As described above, according to the embodiments 
4 to 6, the animating image data which was encoded by 
the animating image coding system using the interframe 
correlation is once encoded by the intraframe coding 
system and is animating image edited and is again 
encoded by the animating image coding system. Thus, 
the animating image data of the coding data which 
cannot be directly animating image edited so far can be 
edited. The capacity of the image memory that is 
needed during the editing operation can be remarkably 
reduced. 

Further, since the amount of animating image 
data to be decoded when a predetermined frame is edited 
can be decreased, the memory capacity can be saved and 
the processes can be executed at a high speed. 

The present invention is not limited to the 
foregoing embodiments but many modifications and 
variations are possible within the spirit and scope of 
the appended claims of the invention. 



